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REMARKS 

This Amendment is requested for the purpose of claiming that 
which Applicant is entitled. 

Claims 20-47, 76-108, and 137-207 are now pending. 

The undersigned hereby certifies that no new material has 
been added. 

Entry of this amendment is respectfully requested. 
Specification 

A marked-up copy of the substitute specification was filed 
on August 4, 1999. However, a clean copy of the substitute 
specification had not been supplied therewith (in addition to the 
marked-up copy). See 37 CFR 1.125 and MPEP 608. 01 (q). 

Accordingly, a marked-up copy of the substitute 
specification is filed herewith, showing the matter being added 
to and the matter being deleted from the specification of record. 

Also filed herewith is a substitute specification submitted 
in clean form without markings as to the amended material. 

This substitute specification is filed to correct 
typographical errors . 

The substitute specification includes no new matter. 

Acknowledgment of both the receipt and entry of the 
substitute specification is respectfully requested. 
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Claims 

Canceled claims 109-136 are now presented as newly added 
claims 180-207. 

It is noted that canceled claims 48-75 and 109-137 were 
previously rejected under 35 USC 101 as allegedly claiming the 
same invention as that of claims 1-28 of prior U.S. Patent No. 
5, 963, 668 . 

However, as a rule, "'same invention' double patenting is 
based upon 35 U.S.C. Section 101 (1994), which states that an 
inventor may obtain 'a patent' for an invention." In re Lonardo, 
43 USPQ2d 1262, 1266 (Fed. Cir. 1997). See MPEP 804. "'Same 
invention' means identical subject matter. A good test is whether 
a claim to one invention could be literally infringed without 
literally infringing a claim to the other. Where the claim in the 
application and the patent claim cross read, 35 USC 101 forbids 
the grant of the second patent." (citations omitted). In re 
Hallman, 210 USPQ 609, 611-612 (CCPA 1981) . 

"Obviousness -type double patenting, on the other hand, is 
judicially created and prohibits an inventor from obtaining a 
second patent for claims that are not patentably distinct from 
the claims of the first patent. With obviousness -type double 
patenting, however, a terminal disclaimer may overcome that basis 
for unpatentability." In re Lonardo, at 1266. 

Here, instant claims 137-192 and claims 1-28 of prior U.S. 
Patent No. 5,963,668 do not cross read, and thus, are not the 
"same invention." Instead, the differing scope of instant claims 
137-192 and claims 1-28 of prior U.S. Patent No. 5,963,668 
renders "same invention" type double patenting as non-existent. 
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Terminal Disclaimer 

A terminal disclaimer has been filed on June 22, 2000. 

Conclusion 

Favorable reexamination and reconsideration of the 
application in light of the amendments and remarks is courteously 
solicited. 

If the Examiner has any comments or suggestions that could 
place this application in even better form, the Examiner is 
requested to telephone the undersigned attorney at the below- 
listed number. 



RADER, FISHMAN & GRAUER, PLLC 

Lion Building 
1233 20^^ Street, N.W. 
Washington, D.C. 20036 
Tel: (202) 955-3750 
Fax: (202) 955-3751 



DATE: October ^, 2 000 



R^naldfi P . Kananen 
RPs^yNb. 24,104 



Respectfully submitted. 
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This application is a continuation of application 
Serial No. 08/755,129, filed on November 25, 1996, now U.S. 
Patent No. 5, 963,668. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a method and 
apparatus for hierarchically approximating shape data with an 
image, in which [a] the data amount is reduced by reducing [a] 
the complexity of [a] the shape of a geometric model which is 
used in generating CG (Computer Graphics) , thereby enabling the 
CG to be drawn at a high rate of speed. The invention also 
relates to a method and apparatus for hierarchically 
approximating shape data with an image, which is suitable for 
use in a game using CG, VR (Virtual Reality) , designing, and the 
like since a shape which was approximated so as not to give a 
sense of incongruity is changed. 

Description of the Prior Art 

When drawing using a model [by the CG] as part of 
computer graphics , the same model ^[is generally always used] may 
be used repeatedly . For example, as shown in Fig. 14, a 
detailed original model having data of 100% is formed and the CG 
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is drawn on a display by using it repeatedly . [Even when] When 
the model is arranged in a far position in a picture plane and 
[looks] is rendered smaller, [since] the same model still is 
used, [a] and the degree of details of the model is not changed. 
Therefore, the time required for the drawing depends on the 
degree of [details] detail of the model and the number of 
models . 

However, when the observer pays no attention to [a] 
the model because the model is [arranged far] minimized and 
loolcs smaller on the picture plane or the model is out of a 
target point of the picture plane, it is not always necessary to 
draw by using the model having [the same details] a high degree 
of detail . That is, by using a similar model in which a degree 
of [details is deteriorated] detail is decreased to a certain 
extent by using a method of reducing the number of vertices of 
the model, reducing the number of planes of a polygon, or the 
like, it can [be seen] appear as if the same model is used. 
Fig. 15 shows such an example. When the model is [arranged far] 
to appear at a distance and its size on the picture plane is 
small, as shown in the example, it is sufficient to draw the CG 
by using [a model] models in which data is reduced to, for 
example, 50% [and] or 25% [for] from that of the original model 
and [a] for which the degree of [details] detail is reduced [and 

2 



SON-1648/CON 
Marked-up Specification 

which was approximated] . By using [the] a model having a data 
amount smaller than that of the original model as mentioned 
above, a high drawing speed can be realized. 

Such an approximation of the model is useful for the 
drawing of the CG [model] display as mentioned above. However, 
if the data amount of the 'model is simply reduced [when] by 
approximating [by reducing the degree of] the details of the 
model, the observer feels incongruity when he sees the 
approximated model. [When the] If this sense of incongruity can 
be suppressed, requests for both of the drawing speed and the 
drawing quality can be satisfied. For this purpose, it is 
desirable to reduce the data amount in a manner such that a 
general characteristic portion of the model is left and the 
other portions are reduced. Hitherto, such an approximation of 
the model is often executed by [a] the manual worJc of a 
designer, so that much [troublesomeness] expense and time are 
necessary for the above worlc. 

A method of obtaining a more real istic image by 
adhering a two-dimensional image to a plane of a model as a 
drawing target is generally used. This is called a texture 
mapping. The image [which] that is adhered in this instance is 
called a texture. When the approximation of the shape as 
mentioned above is executed to the model which was subjected to 
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the texture mapping, it is necessary to also pay attention to 
the texture adhered to the model plane. That is, it is 
necessary to prevent a deterioration [of the looking] in the 
appearance of the model due to a deformation of the texture 
shape at the time of approximation and to prevent the occurrence 
of a [trouble] problem such that [a whole worlc amount] the 
amount of work is increased since the texture [is] must be again 
adhered to the approximated model . 

In [the] past studies, according to Francis J. M. 
Schmitt, Brian A. Barsky, and Wen-Hui Du, "An Adaptive 
Subdivision Method for Surface-Fitting from Sampled Data", 
Computer Graphics, Vol. 20, No. 4, August, 1986, although the 
shape is approximated by adhering the Bezier patch to a 
three-dimensional shape, there is a problem in that a general 
polygon is not a target. 

According to Greg Turk, "Re-Tiling Polygonal Surface", 
Computer Graphics, Vol. 26, No. 2, July, 1992, a trial of 
hierarchically approximating a polygon model is executed. There 
is, however, a problem [such] in that although the algorithm in 
the above paper can be applied to a round shape, it is not 
suitable [to] for a square shape and a general shape is not a 
target. Further, it is not considered to approximate the shape on 
the basis of characteristic points of the object shape. 
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Further, according to Hugues Hoppe et al . , "Mesh 
Optimization", Computer Graphics Proceedings, Annual Conference 
Series, SIGGRAPH 1993, a model is approximated in a manner such 
that [an] energy is introduced to an evaluation of the 
approximated model, and operations for removing the edge, 
dividing the patch, and swapping the edge are repeated so as to 
minimize the energy. According to the method of the paper, 
however, it is necessary to execute a long repetitive calculation 
until the minimum point of the energy is determined [found out] . 
In addition, a solving method such as a simulated annealing or 
the lilce is necessary in a manner similar to other energy 
minimizing problems so as not to reach a local minimum point. 
There is no guarantee that the energy minimum point is always 
visually the best point. 

Further, in those papers, no consideration is made up 

to the texture adhered to the model upon approximation. 

Consequently, the method of approximating the model according to 

the methods in the papers has a problem [such] in that double 

processes are required in which the texture is newly adhered to 

the approximated model after the approximation. 

As mentioned above, the past studies have problems 

regarding the approximation of a model when a polygon is drawn. 

That is, the conventional method has problems such that 
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application of the shape approximation is limited, a long 
calculation time is necessary for approximation, and the 
approximation in which [generally-needed] required 
characteristic points are considered is not executed. The 
approximation of figure data to realize a switching of 
continuous layers, in which the sense of incongruity to be given 
to the observer at the time of the switching of the approximated 
model is considered, is not executed. 

When the approximation is executed to the geometric 
model to which the texture is adhered, there is a problem [such] 
in that a measure to prevent a quality deterioration after the 
approximation^, by keeping the shape of the texture adhered to the 
modelj. is not taken. There is also a problem [such] in that a 
measure to eliminate [a] the necessity to newly adhere the 
texture after the approximation is not taken. Further, there is a 
problem that the approximation in which the existence of the 
texture itself is considered is not executed. 

OBJECTS AND SUMMARY OF THE INVENTION 
It is, therefore, an object of the invention to 
provide a method and apparatus for hierarchically approximating 
figure data with an image in the drawing of CG [as if the] so 
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that high-speed drawing is performed while maintaining a quality 
of the drawing. 

It is another object of the invention to provide a 
method and apparatus for hierarchically approximating figure 
data with an image as if the approximation of a geometric model 
is performed in consideration of the existence of a texture 
itself . 

According to the invention, in order to solve the 
above problems, there is provided a hierarchical approximating 
method of shape data for approximating shape data to data of a 
desired resolution, comprising the steps of: evaluating an 
importance of each of the edges which construct the shape data; 
removing an unnecessary edge on the basis of a result of the 
edge evaluation; and determining a vertex position after the 
unnecessary edge was removed. 

According to the invention, in order to solve the 
above problems, there is provided a hierarchical approximating 
method of shape data with an image for approximating shape data 
to which image data was adhered to data of a desired resolution, 
comprising the steps of: determining which edge in the shape 
data should be removed upon approximation; determining a new 
vertex position in the shape data after the edge removal 
performed on the basis of the edge removal determination; and 
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removing an unnecessary vertex in the image data adhered to the 
shape data in accordance with outputs from the edge removal 
determining step and the vertex movement determining step and 
moving a vertex on the image data in accordance with the new 
vertex position in the shape data. 

According to the invention, in order to solve the above 
problems, there is provided an approximating apparatus [of] for 
figure data for approximating shape data to-that of a desired 
resolution, comprising: evaluating means for evaluating an 
importance of each of the edges which construct the shape data; 
edge removing means for removing an unnecessary edge on the 
basis of a result of the edge evaluation; and vertex position 
determining means for determining a vertex position after the 
unnecessary edge was removed. 

According to the invention, in order to solve the above 
problems, there is provided a hierarchical approximating 
apparatus ^ [of] for figure data with image data for approximating 
shape data to which image data is adhered to data of a desired 
resolution, comprising: edge removal determining means for 
determining which edge in the shape data is removed upon 
approximation; vertex movement determining means for determining 
a new vertex position in the shape data after the edge removal; 
and image data removal and movement determining means for 
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removing an unnecessary vertex in the image data adhered to the 
shape data in accordance with outputs from the edge removal 
determining means and the vertex movement determining means and 
for moving the vertex on the image data in accordance with the 
new vertex position in the shape data. 

According to the invention as mentioned above, the 
importance of each of the edges of the shape data is evaluated, 
the unnecessary edge is removed on the basis of the evaluation, 
a new vertex after the edge removal is determined, and further, 
the vertex is moved on the image data in accordance with the new 
vertex position. Thus, the shape data can be approximated so 
that the change in shape is little while suppressing the 
deterioration of the image data adhered to the shape model. 

The above and other objects and features of the 
present invention will become apparent from the following 
detailed description and the appended claims with reference to 
the accompanying drawings . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a flowchart of a hierarchical approximation 
of a texture mapped polygon model according to the invention; 

Fig. 2 is a diagram showing an example of a drawing 
apparatus [which] that can be adhered to the invention; 
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Figs. 3A and 3B are schematic diagrams for explaining 
equation (1) ; 

Figs. 4A and 4B are schematic diagrams showing an 
example of a vertex position decision; 

Figs. 5A and 5B are schematic diagrams showing an 
example of a method of determining a position at which a vertex 
to be left is put; 

Figs. 6A and 6B are diagrams schematically showing an 
example in which a texture is allocated on a certain plane of a 
polygon model; 

Figs. 7A and 7B are diagrams schematically showing an 
integration of vertices and texture coordinates in association 
with an edge removal; 

Figs. 8A to 8C are diagrams for explaining that the 
texture is changed by the integration of the vertices; 

Figs . 9A to 9D are diagrams for explaining a case 
where two different textures are adhered to one 
polygon; 

Fig. 10 is a schematic diagram for explaining an 
equation (2) ; 

Figs. IIA to lie are schematic diagrams showing 
examples of a method of forming an approximate model of a middle 
layer; 
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Fig, 12 is a diagram schematically showing an example 
of a processing result according to an embodiment of the 
invention; 

Fig. 13 is a diagram schematically showing an example 
of a processing result according to an embodiment of the 
invention; 

Fig. 14 is a schematic diagram showing an example of a 
CG drawing according to a conventional method; and 

Fig. 15 is a schematic diagram showing an example of a 
desirable CG drawing. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

An embodiment of the invention will now be described 
hereinbelow with reference to the drawings. Fig. 1 is a 
flowchart for a hierarchical approximation of a geometric 
(polygon) model [which] that was subjected to a texture mapping 
according to the invention. Fig. 2 shows an example of a 
structure of a drawing apparatus [which] that can execute the 
processes of the flowchart . 

As shown in Fig. 2, the drawing apparatus can be 
constructed by a computer with a standard structure which 
comprises: a keyboard 1; a data input device such as floppy disk 
drive (FDD) 2, magnetooptic disk (MO) drive 3, or the like; a 
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data processing apparatus constructed by a CPU 4, an RAM 5, and 
the like; an external memory apparatus such as hard disk 6, 
semiconductor memory 7, or the like; and a display apparatus 8 
such as a CRT or the like, and in which those component elements 
are respectively connected by a bus 9. As an input device, a 
mouse or the like [is] may also be used. The floppy disk drive 
2 and MO drive 3 are also used as data output devices. Further, 
data can be also supplied from a network such as [an] the 
internet. The above structure is an example and the actual 
drawing apparatus can have various constructions. 

First, processes in the flowchart shown in Fig. 1 will 
be schematically described. A texture as image data is allocated 
and adhered to each plane of a polygon. In the invention, in 
order to approximate the polygon, edges constructing the polygon 
are removed and the shape is approximated. Since the shape of 
the polygon is merely approximated by only removing the edges, 
in order to approximate the textures allocated to the planes of 
the polygon, an optimization is executed by integrating the 
textures associated with the edge removal and moving the 
coordinates of the textures . 

In the first step SI, original polygon data is 
inputted. The texture is adhered to each plane for the inputted 
polygon data. The input of the data and the adhesion of the 
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texture are manually performed from the keyboard 1 or by a 
method whereby data which has been made in another place and 
stored in a floppy disk or an MO disk is read out by the FDD 2 
or MO drive 3 . The polygon data can be also inputted through a 
network such as [an] the internet. 

In step S2, each-edge of the inputted polygon data is 
evaluated for performing the edge removal . In the edge 
evaluation in step S2, each edge of the inputted polygon data is 
converted into a numerical value by a method, which will be 
described [hereinlater] below, and is set to an evaluation 
value. In step S3, the evaluation values of the edges obtained 
in step S2 are sorted and the edge having the minimum evaluation 
value is selected. The processing routine advances to step S4 . 
In step S4, the edge having the minimum evaluation value [which] 
that was selected in step S3 is removed. 

When the edge is removed in step S4, the processing 
routine advances to step S5 . In step S5, the position of the 
vertex which remains after the edge was removed in step S4 is 
determined. In step S6, the texture portion which becomes 
unnecessary in association with the edge removal is removed and 
the positions of the remaining texture coordinates are 
determined. 
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[The approximated] Approximated polygon data [which] 
that was approximated at a precision of one stage and was 
subjected to the texture mapping is obtained by the foregoing 
processes in steps S2 to S6. The edge removal, the determination 
of a new vertex, and the process of the texture in association 
with them are repeated by repeatedly executing the processes in 
steps S2 to S6. Consequently, the approximated polygon data, 
which was subjected to the texture mapping can be obtained at a 
desired precision. 

When the approximated polygon data [which] that was 
subjected to the texture mapping at a desired precision in step 
S6 is obtained (step S7) , the processing routine advances to 
step S8. The obtained approximated polygon data [which] that was 
texture mapped is drawn on the display apparatus 8 . The obtained 
approximated polygon data which was texture mapped can be also 
stored into an external memory apparatus such as a hard dislc 6 
or memory 7, a floppy dislc inserted in the FDD 2, or an MO 
inserted in the MO drive 3. The derived data can be also 
supplied and stored to another computer system through the 
networlc. 

The processes in the above flowchart are executed 
mainly by the CPU 4 in the hardware structure of Fig. 2. 
Instructions or the liJce which are necessary during the 
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processes are sent from the input such as a keyboard 1 or the 
like to the CPU 4. 

Processes regarding a model approximation will now be 
described. As mentioned above, the approximation of the polygon 
model is executed by repeating the edge removal. In this 
instance, small convex and concave components which do not 
contribute to [a] the general shape of the model are judged and 
edges which should be preferentially removed are determined on 
the basis of the judgement result. In order to select the edges 
which are preferentially removed, [how] the extent to which the 
edges constructing the model contribute to the general shape, 
namely, the importance of [the] each edge is evaluated and the 
removal is executed [from] to remove the edge [of a small] with 
the smallest evaluation value. In step S2, the importance of 

[the] each edge is evaluated. 

In order to select the edge which is suitable to be 
removed by obtaining the evaluation value, an evaluation 
function to evaluate [how] the extent to which each of the edges 
constructing the polygon model contributes to the shape of the 
polygon model is introduced. The following equation (1) shows an 
example of the evaluation function. Figs. 3A and 3B are diagrams 
for explaining the equation (1) . 

[Equation 1] 
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F(e) = XK+ft<5,| -(1) 

where 

V,=(NrE)xA, 
S,=\e\xA. 

Fig. 3B shows an example in which a part of a spherical 
polygon model shown in Fig. 3A in which each plane is 
[constructed] bounded by a triangle is enlarged. By the 
equation (1) , an edge e constructed by two vertices Vi and V2 is 
evaluated. With respect to the vertices Vi and V2 [constructing] 
bounding the edge e (vi, V2) , when sets of planes including them 
as vertices assume S (vi) and S(v2), a range of i is set to S (vi) 
u S(v2) . That is, 1 < i < 10 in the example shown in Fig. 3B. In 
the diagram, E denotes a vector having the direction and length 
of the edge e; Ni denotes a unit normal vector of each plane; Ai 
denotes an area of the plane; and |e| a length of the vector E. 

The equation (1) is constructed by two terms. The first 
term Vi shows a volume amount which is changed when the edge as 
an evaluation target is removed. The volume amount here denotes 
a virtual volume of a shape specified by the shape data of the 
polygon. The second term Si shows a value obtained by multiplying 
the planes existing on both sides of the target edge with the 
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length of the target edge. It denotes a change amount of the 
volume of the plane including only the target edge. Coefficients 
a and b are multiplied to the two terms. The user can select 
which one of the first term Vi and the second term Si is 
preferentially used by properly setting the values of the 
coefficients . 

The first term Vi largely depends on the peripheral 
shape of the edge as an evaluation target. On the other hand, 
the second term Si depends on the length of the target edge and 
the area of planes existing on both sides of the target edge. In 
the case of a polygon model having a flat shape like a sheet of 
paper, when the edge e (vi and V2) is removed, the change amount 
by the term Si is larger than that by the term Vi. In the polygon 
model constructed by planes in which all of them have similar 
shapes and areas, for example, in the model shown in Fig. 3A, 
the change amount by the term Vi is larger than that by the term 
Si. 

The value of the equation (1) is calculated with 
respect to each of the edges constructing the polygon model and 
the evaluation value for each edge is obtained. In step S3, the 
calculation values are sorted in accordance with the values and 
the edge having the minimum evaluation value is selected, 
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thereby obtaining the edge whose contribution to the model shape 
when the edge is removed is the smallest. 

When the importance of the edge is evaluated in step 
S2, the length of edge is considered. When the evaluation values 
are the same, the shorter edge can be also set [to] as a target 
to be removed. 

Although the local evaluation value in the polygon 
model is obtained by the equation (1) , each edge can be also 
evaluated by a value obtained by adding the evaluation values of 
the peripheral edges to the evaluation value of a certain target 
edge. In this case, the evaluation can be performed not only 
with the peripheral shape of one edge but also with the shape or 
a wide range. When the area which the user wants to evaluate is 
wide as mentioned above, the calculation range of the equation 
(1) can be widened in accordance with such a wide area. 

In addition to the evaluation value simply derived by 
the calculation of the equation (1) , the user can give the 
evaluation value or can operate the evaluation value. Therefore, 
when there is a portion which the user wants to leave [in the 
shape] intact without approximation or a portion which he, 
contrarily, wants to [promptly] approximate, the intention of 
the designer or operator can be reflected [to] in the 
approximating process by designating such a portion. In this 
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case, the evaluation value is determined by executing a weighted 
addition by giving a weight coefficient to each of the value 
operated by the user and the calculated evaluation value. 

In this case, the approximation in which the intention 
of the designer is reflected [stronger] can be performed 
[depending on a way of] by giving a weight coefficient, for 
example, by giving [a large] weight to the evaluation value 
designated by the user. On the contrary, when a large weight is 
given to the evaluation value obtained by the calculation of the 
equation (1) , an accurate approximation can be performed by a 
quantitative evaluation of the volume change in shape. In this 
manner, the change in shape can be freely controlled by the 
weighting process. 

When the evaluation values for the edges of the polygon 
data are obtained in step S2 as mentioned above, the obtained 
evaluation values are sorted and the edge having the minimum 
evaluation value is selected in step S3. When sorting the edges, 
for example, a quick sorting as a known technique can be used. 
Other sorting methods can be also obviously used. Since the 
sorting methods including the quick sorting are described in 
detail in "Algorithm Dictionary" published by Kyoritsu 
Publication Co., Ltd. or the like, the description is omitted 
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here. The selected edge having the minimum evaluation value is 
removed in step S4 . 

Although the case where the edge having the minimum 
evaluation value is simply removed has been described here, the 
removing order of the edges or the edge which is not removed can 
be also arbitrarily designated. When the edge is not removed, 
there is no change in shape of such a portion. For example, in 
the case where it is desirable that the shape is not changed^, 
like a portion in which two models are in contact each other, it 
is sufficient to set a portion where no edge is removed.- 

When the edge is removed in step S4 , the vertices (vi 
and V2 in this case) constructing the edge are lost . In step S5 , 
therefore, a new vertex position in association with the edge 
removal is determined. Figs. 4A and 4B show examples of the 
vertex position determination. After the edge was removed, 
either one of the two vertices constructing the edge is left. In 
this case, the edge e (vi and V2) in a layer N in Fig. 4A is 
removed, thereby obtaining a layer (N + 1) shown in Fig. 4B. The 
vertex Vi remains and becomes a new vertex v* . 

In this instance, the shape after the edge removal is 
changed [in dependence] depends on the position of the vertex vi 
which remains. Figs. 5A and 5B [shows] show examples of a 
method of determining the position where the vertex to be left 
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is located. Figs. 5A and 5B show cross sectional views of an 
edge shape in the polygon data. That is, Fig. 5A shows a case 
where the edge e(vi, V2,) [constructed] bounded by the vertices 
Vi and V2 is formed in a convex shape [for] including the outer 
edges of Vi and V2 . Fig, 5B shows a case where the edge e(vi, V2,) 
[which sandwiched from] is between the upper and lower 
directions [by] of the outer edges of vi and V2 [and is formed 
in] forming an S shape. In Figs. 5A and 5B, v' indicates a 
vertex to be left . 

In Figs. 5A and 5B, areas Si and S2 shown by hatched 
regions show volume change amounts when the edge e{vi, V2) is 
removed and the vertex v' is left. The vertex v* which is left 
after the edge e(vi, V2) was removed is positioned where the 
volume change amount Si on the vertex Vi side and the volume 
change amount S2 on the vertex V2 side are equal . By arranging 
the vertex to the position where the volume change amounts on 
both sides of the removed edge e(vi, V2) are equal as mentioned 
above, the shape after the edge removal can be [more] 
approximated to the original shape. 

Although the vertex vi which is left and becomes a new 
vertex is arranged to the position where the volume change 
amounts on both sides of the edge are equal irrespective of the 
peripheral shape of the edge which is removed in step S5 in the 
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above description, the invention is not limited to the example. 
For example, the vertex v' can be also arranged at a position 
where the volume change upon edge removal is the minimum. As 
mentioned above, the method of arranging the vertex v' to the 
position where the volume change amounts on both sides of the 
edge are equalized and the method of arranging the vertex v' to 
the position where the volume change is the minimum can be 
selectively used in accordance with a desire of the user. 

In consideration of the peripheral shape of the edge, 
when the shape has a concave or convex shape, the vertex v' can 
be also arranged at a position where the volume change after the 
edge removal is the minimum. When the periphery has an 
S- character shape, the vertex v* can be arranged at a position 
where the volume change amounts on both sides of the edge are 
equalized. In this case, the position of the vertex v' is 
deviated to either one of the ends of the edge in the case of 
the concave or convex shape. In case of the S- character shape, 
the vertex v* is arranged in the middle of the S character. 
Thus, both of an effect to suppress the volume change and an 
effect to absorb the continuous changes like an S character by 
the plane can be [derived] achieved . 

For example, an area [in which a change] having a 
small S-character shape [continues] like a saw tooth can be 
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approximated by one plane in a general shape. A portion having a 
large change except the S- character shape can be approximated by 
a shape which is closer to the original shape. In the 
approximation in which the shape has a priority, such a setting 
is also possible. The approximating methods can be selectively 
used in accordance with the intention of the user. 

It is also possible not to change the vertex position 
remaining after the edge removal from the vertex position before 
the edge removal. That is, in the example shown in Figs. 4A and 
4B , [for example,] after the edge e(vi, V2) was removed, only 
the vertex Vi is left as a new vertex v' without changing the 
position from the position before the removal. This is effective 
means when it is desirable not to move the position of a target 
vertex because the target vertex exists at a contact point with 
the other model or the like. 

When the edge is evaluated and removed and the new 
vertex in association with the edge removal is determined in the 
steps up to step S5, a process regarding the texture adhered to 
each plane of the polygon model is executed in step S6. Figs. 6A 
and 6B schematically show examples in which image data (texture) 
is allocated to a certain plane on the polygon model. Fig. 6A 
shows a polygon model itself comprising vertices Vi to Ve . It 
shows that when an edge e(V3, Ve) shown by a broken line is 

23 



SON-1648/CON 
Marked-up Specification 

removed from the model shown in the left diagram, the model is 
approximated to a shape shown in the right diagram. 

Fig. 6B shows a state in which a texture is adhered to 
the polygon model shown in Fig. 6A. In this instance, for easy 
understanding, image data based on a portrait is used as a 
texture. Coordinates vti to vte in Fig. 6B correspond to the 
vertices Vi to Vs in Fig. 6A, respectively. Fig. 6B, therefore, 
shows that the coordinates vti to vts in the diagram on the left 
side are changed as shown in a diagram on the right side in 
association with the removal of the edge e(V3, Vg) in Fig. 6A. 

The vertex Vg is removed by the approximation of the 
polygon model and the two vertices V3 and vg in this model are 
integrated to one vertex V3 . In association with it, by removing 
the edge e(v3, Vg) comprising V3 and Vg, triangular areas on both 
sides including [such an edge is] the removed edge are lost. In 
this instance, unless the loss of those triangular areas is 
considered, the image data comprising the texture coordinates 
Vt3, Vt4, and Vtg and the image data comprising Vt3, vts, and Vtg 
are lost. 
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As shown by the texture in the diagram on the right 
side in Fig. 6B, therefore, it is necessary to execute an 
integration and a position movement to the 
texture in accordance with the approximation of the edge 
removal. Thus, the continuous image data on the approximated 
model surface can be reproduced. 

In this example, the vertices V3 and Vg are integrated 
on the polygon model and the vertex V3 remains. The remaining 
vertex V3 is set to a vertex V3 ' . The position of the vertex V3 ' 
is arranged at a predetermined distribution ratio t on the 
coordinates between the edge e(v3, vg) comprising V3 and Vg before 
approximation. In this case, the coordinates of the vertex V3 ' 
can be calculated by [[]I(1 - t) x V3 + t x VelL]] . When 0 < t < 
1, the distribution coefficient t exists on the edge straight 
line of the edge e(v3, Vg) before approximation and, when t < 0 
or 1 < t, t exists out of 

the edge e (V3 , Vg) . By changing a value of t, therefore, a 
shape change amount after the model was approximated by the edge 
removal can be controlled. ■ 

As mentioned above, the vertices V3 and Vg are 
integrated on the polygon model and are set to the vertices V3 ' 
and V3 ' is arranged between the vertex V3 and the vertex vg. The 
texture coordinates vt3 and vtg corresponding to those two 
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vertices are, therefore, also integrated to the coordinates Vta 
after approximation and are set to coordinates vta * . The 
coordinates vts ' are arranged between the coordinates Vta and vte 
before approximation. 

Figs. 7A and 7B schematically show the integration of 
vertices and the integration of texture 

coordinates in association with the edge removal. Fig. 

7A shows an example in which the integrated vertex V3 ' 

is arranged to the position calculated by [[]J.(1 - t) x V3 + t x 

VelL]] in association with the removal of the edge e(v3, vg) . A 

distribution of the remaining texture 

coordinates can be obtained in a manner similar to the 
arrangement of the vertex V3 ' based on the distribution 

t. That is, as shown in Fig. 7B, as for the distribution of the 

remaining texture coordinates Vts ' , by calculating [[]_(.(1 - t) x 

Vt3 + t X Vt6i.[]] in a manner similar to the distribution t 

between the above vertices V3 and Vg, an image can be distributed 

in a form according to a change in model shape to which the 

image is adhered. Thus, as shown in the diagram on the right 

side of Fig. 6B, the textures can be continuously adhered to the 

polygon model . 

In this instance, when the position of the coordinates 

Vt3 Of the texture data corresponding to the vertex V3 on the 
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polygon model is not changed in accordance with the change in 
model shape as mentioned above, for example, in the texture 
shown in Fig. 6B, an image existing at the position of the face 
corresponding to the triangular plane including the removed edge 
e(V3, Vfi) cannot be adhered to the model. 

With respect to an original polygon model 
shown in Fig. 8A, for example, when the coordinates vte on the 
texture allocated to the vertex vg are made correspond to the 
remaining vertex V3 side from the integration relations of 
vertices after the removal of the edge e without considering the 
image data allocated to the triangular plane which disappears at 
the time of the removal of the edge e(V3, Vg) , the portion of the 
face disappears as shown in Fig. 8B. Further, when the 
coordinates of Vta before the edge removal are succeeded as they 
are after the edge removal without considering the integration 
relation of the vertices at the time of the removal of the edge 
e, as shown in Fig. 8C, since the coordinates of the vertex V3 
change after the removal of the edge e and an area of each plane 
changes, the resultant image to which the texture was adhered is 
distorted. That is, the texture data also needs to be changed 
in accordance with the change in plane and change in model 
vertex position due to the edge removal. 
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When the texture is adhered to the polygon model, 
there is a case where not only one texture but also a plurality 
of different textures are allocated to the model. In this case, 
a boundary in which the texture is switched from a certain 
texture to another texture exists. 

In case of adhering the texture to the polygon model, 
as mentioned above, the texture is allocated to each vertex of 
the model. Even in the boundary of the texture, therefore, the 
boundary is allocated to each vertex constructing the edge of 
the model. Further, as mentioned above, the approximation of 
the model is performed by repeating the edge removal only a 
desired number of times. In this instance, if the texture area 
allocated to the edge as a target of the removal is in the 
texture, as shown in Figs. 6 and 7 mentioned above, the model 
can be approximated while holding a continuity of the image. 

However, when the area of the image allocated to the 
edge as a removal target exists just on the boundary of the 
image, the polygon model is approximated by the edge removal and 
since the vertex position is moved, a plurality of textures are 
mixed and the [shape of] appearance of the texture is broken. 
To prevent [it] this, it is necessary to make a discrimination 
so as not to break the image boundary at the time of the edge 
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removal and to decide sizes of a change of the outline portion 
by the edge removal . 

As shown in Fig. 9A, two different textures [of a 
texture] comprising [the] an image of [the] a hatched portion 
and [a texture comprising the] an image of [the] a face 
[portion mixedly exist and] are both adhered to one polygon 
model. Fig. 9B shows a certain continuous edge train in the 
model shown in Fig. 9A. In the model shown in Figs. 9A and 9B, 
for example, when the edge e(v4, V5) comprising the vertices V4 
and V5 is removed and the vertex V4 is left after the removal, 
when executing a process to arrange a vertex V4 ' based on the 
vertex V4 to the middle position of the edge e(v4, V5) as a 
removal target, an outline portion of the edge changes as shown 
in Fig. 9C. 

In this case, since the outline portion of the face 
image has also been adhered to each of the vertices V3 to Vg, as 
shown in Fig. 9D, the shapes of the two adhered images are 
broken. In this example, the shape of the lower portion of the 
face picture is largely changed and the image of the hatched 
region increases. As mentioned above, in the edges of the model 
to which the outline portion of the image is allocated, if the 
edge removal is simply repeated as mentioned above, the quality 
after the approximation is deteriorated. 
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To prevent [it] this , a removal evaluating function of 
the edge as a boundary portion of the texture is introduced and 
when the shape of the texture boundary is largely changed by the 
edge removal, it is necessary to use any one of the following 
methods. Namely, as a first method, the relevant edge is not 
removed. As a second method, although the edge is removed, a 
movement amount of the vertex position after the removal is 
adjusted . The following equation (2 ) is used as a removal 
evaluating function of each edge in this instance. Fig. 10 
shows a diagram for explaining the equation (2) . 

F{e) = Y\iNrE)xL,\ ...(2) 

In the equation (2) , E denotes the vector having the 
direction and length of the edge e, Ni indicates the normal 
vector of the edge, and Li the length of edge. A range of i 
corresponds to the whole edge of the boundary lines existing 
before and after the edge as a removal target. The equation (2) 
denotes an area change amount when the edge of the boundary 
portion is removed. Therefore, when the calculation value of 
the equation (2) is large, a change of the outline portion by 
the edge removal is large. 
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Namely, when the calculation value of the equation (2) 
is large, the area change in the outline portion of the texture 
increases, so that there is a fear of occurrence of the breakage 
of the texture shape. To prevent [it] this, there is a method 
whereby the relevant edge is not removed like the foregoing 
first method. However, like the foregoing second method, there 
is also a method whereby the texture coordinates after the edge 
removal are moved within a range where the value of the equation 
(2) is smaller than the designated value, thereby consequently 
decreasing the change amount of the outline portion. By using 
the second method, the breakage of the texture after the 
approximation can be suppressed. 

As mentioned above, the approximated polygon model to 
which the texture having a desired precision is adhered can be 
obtained. In this case, when the texture is adhered to the 
original model, there is no need to again adhere the texture to 
the model after completion of the approximation and the 
approximated model with the texture can be automatically 
obtained. 

As mentioned above, the approximated model obtained by 
repeating the processes in steps S2 to S6 is stored [into] in 
the external storing apparatus such as hard disk 6 or memory 7. 
However, when displaying in step S8, the approximated model 
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Stored in the external storing apparatus is read out, drawn, and 
displayed to the display apparatus 8. As already described in 
the foregoing prior art, in this display, for example, when the 
model is displayed as a small image on the picture plane because 
it [is arranged] appears at a remote location or when the 
observer [doesn't pay attention to] fails to notice the model 
because it is out of the target point on the picture plane, the 
model is switched to the model of a layer that was [more] 
approximated and the image is displayed. 

Upon switching [of] to the approximated model, if the 
model is suddenly switched to the model in which a degree of 
approximation largely differs, a sudden change occurs in the 
shape of the displayed model at a moment of the switching and a 
feeling of disorder is given to the observer. 

To prevent that [the] feeling of disorder [is given] , 
it is sufficient that a number of models whose approximation 
degrees are slightly changed are prepared and stored into the 
external storing apparatus and the display is performed while 
sequentially switching those models. In this case, however, 
since an amount of models to be stored increases, it is [no] not 
efficient. Therefore, to realize a smooth continuous conversion 
even [in the] with a small number of models, it is sufficient to 
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interpolate the model among the discrete layers and to obtain 
the model of the middle layer. 

For example, in the example shown in Figs. 4A and 4B 
mentioned above, the vertex after the edge e(vi, V2) was removed 
is set to v' . However, as for the 

vertex v' , it is considered that the vertices Vi and V2 
in the edge e(vi, V2) approach each other and become 
the vertex v' . Namely, the vertices Vi and V2 are 
consequently integrated to the vertex v' . As mentioned 
above, since the correspondence relation of the 
vertices before and after the edge removal is known, 
the data between the data before and after the edge 
removal can be obtained by an interpolation from the 
data before and after the edge removal by using the 
correspondence relation of the vertices. 

Such a forming method of the approximated model in the 
middle layer between the discrete layers has already been 
described in detail in Japanese Patent Application No. 6-248602 
regarding the proposition of the present inventors. 

Figs. IIA to lie show the formation of the 
approximated model of the middle layer using the correspondence 
relation of the vertices between two layers as mentioned above. 
In Figs. IIA to IIC, a layer before the edge removal is set to a 
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layer N as shown in Fig. IIA and a layer after the edge removal 
is set to a layer N+1 as shown in Fig. IIC, thereby obtaining a 
model of a middle layer N' shown in Fig. 6B from those two 
layers . 

In the example, the vertices Vi, and V2 [constructing] 
bounding the edge e(vi, V2) of the layer N are integrated to vi 
in the layer N+1 and the deleted vertex V2 is integrated to vi. 
From the correspondence relation of the vertices, in the middle 
layer N\ the positions of vertices Vi * and V2 ' [constructing] 
bounding an edge e* (vi ' , V2 ' ) corresponding to the edge e(vi, V2) 
of the layer N can be obtained by the linear interpolation 
between the layers N and N+1 . Although the example in which one 
middle layer is obtained is shown here, a degree of linear 
interpolation is changed in accordance with a desired number of 
middle layers and a plurality of middle layers can be obtained. 
The formation of the approximated model of the middle layer can 
be performed in a real-time manner in accordance with a 
situation in which the model is displayed. 

Although the case where the approximated model of the 
middle layer is formed and displayed in a real-time manner while 
displaying the model has been described here, the invention is 
not limited to such an example. For instance, it is also 
possible to [construct] practice the invention in a manner such 
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that the approximated model of the middle layer is previously 
formed and stored in the external storing apparatus and the 
stored approximated model of the middle layer is read out at the 
time of the display. 

Although the case where one edge is removed has been 
mentioned as an example here, since the edge removal is repeated 
a plurality of number of times in the approximation of the 
actual model, one vertex of a certain layer corresponds to a 
plurality of vertices of another layer which is closer to the 
original model. By using the correspondence relation of the 
vertices in those two layers as mentioned above, the vertices of 
the model can be made to correspond among all of the layers. The 
model of the middle layer is obtained on the basis of the 
correspondence relation of the vertices derived as mentioned 
above . 

As mentioned above, since the coordinates of the image 
data in the texture are allocated to each vertex of each model, 
in a manner similar to the case of the vertices of such a model, 
the model to which the texture was adhered in the middle layer 
can be obtained by the interpolation of the texture coordinates 
vti and vt2 allocated to the vertices Vi and V2, respectively. By 
such a process, the models in a range from the original model to 
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the most approximated model can be smoothly continuously 
obtained. 

By the above processes, the discrete hierarchical 
approximated model can be obtained and the model of the middle 
layer can be also obtained. The approximated model obtained and 
stored as. mentioned above is switched in accordance with the 
size, position, speed, and attention point of the viewer of the 
apparent model on the picture plane in the display apparatus 8 
and is displayed in step S8 . Figs. 7A and 7B show examples of 
the approximated model derived by the embodiment . 

Fig. 12 schematically shows an example of the 
processing results according to the embodiment. In this 
example, the original model is a sphere comprising 182 vertices, 
360 planes, and 279 texture coordinates. An image of the earth 
is adhered as a texture to the sphere. It is approximated for 
the original model by reducing every 60% in comparison of the 
number of vertices. Fig. 13 shows a wire frame state of a model 
when the texture of the same approximated model is not adhered. 
In Fig. 12, since the image is consistently held, it is 
difficult to know a degree of approximation, in the approximated 
state before the texture image is adhered as shown in Fig. 13, 
the progress of the approximation can be clearly seen. 
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As [more] specifically shown in Fig. 13, by using the 
present invention, even if the number of vertices is reduced to 
36% or 21,6% of the original model, the hierarchical 
approximated model can be obtained without losing the general 
shape which the original model has . 

Although the case where the texture image is 
adhered to the polygon model has been described above, the 
invention can be also obviously applied to the case where the 
texture image is not adhered. In this case, step 36 can be 
omitted in the flowchart shown in Fig. 1 mentioned above. 

As described above, according to the invention, when 
image data (texture) is adhered to geometric data such as 
polygon data which is used in the CG, the model can be 
approximated to a desired degree of details while preventing the 
breakage of the texture shape or [a] an apparent deterioration 
of the quality. [A troublesomeness such that after the model 
was approximated, the texture is newly adhered can be also 
omitted.] 

According to the invention, therefore, there is an 
effect such that the geometric model which is used in the CG can 
be approximated in a state in which the texture is adhered. 
There is also an effect such that not only is the model [is 
merely] approximated but also the brealcage of the [shape] 
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appearance of the texture in the approximation result can be • 
suppressed. 

By using the geometric model approximated by the 
method based on the invention, in the drawing of the CG, there 
is an effect such that a request for drawing of at a high speed 
and at a high picture quality can both be satisfied. 

Further, according to the invention, an importance 
degree of each edge constructing the geometric model which is 
used for the CG can be evaluated by an evaluation value. There 
is an effect such that the geometric model can be approximated 
by preferentially removing the edge of a low evaluation value of 
the edge . 

According to the invention, the position of the vertex 
remaining after the edge was removed can be determined so as to 
suppress a change in general shape. Thus, there is an effect 
such that a feeling of disorder upon looking when drawing by 
using the approximated model can be suppressed. 

According to the invention, figure data which is used 
in the CG can be approximated by a plurality of resolutions. 
There is an effect such that by using the figure data derived by 
the invention, both of the goals of drawing at a high speed and 
[the] drawing with a high quality can be satisfied. 
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The present invention is not limited to the foregoing 
embodiments but many modifications and variations are possible 
within the spirit and scope of the appended claims of the 
invention. 
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ABSTRACT OF THE DISCLOSURE 
[Polygon data inputted in the] Polygonal data input in 
a first step is subjected to evaluation [of] in whicti all edges 
of tlie polygon data are ran}ced in importance on the basis of a 
volume change [due to an edge removal by a predetermined 
evaluating function in the second step] caused by removal of 
that edge. The edges are sorted on the basis of an evaluation 
value in [the] a third step. In [the] a fourth step, the edge 
of a small evaluation value is determined to be an edge of a 
small influence on [a] the general shape and is removed. In 
[the] a fifth step, a new vertex is determined from the loss of 
vertex by the edge removal. In [the] a sixth step, a movement 
of texture coordinates and a removal of the texture after the 
edge removal are executed on the basis of the area change of the 
texture due to the edge removal by a predetermined evaluating 
function. In [the] a seventh step, by repeating the processes 
in the second to sixth steps, a polygon model approximated to a 
desired layer can be obtained. 
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